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[57] ABSTRACT 

A mechanism is provided for controlling the selection, in a 
single object, of multiple activities implemented by plural 
data structures. The invention provides a control mechanism 
for associating many selection points with many actions. 
That is, instead of associating data with an action, the 
present invention associates the action with the data. 
Therefore, the object of selection becomes the control 
element, rather than merely the initiator of the action. Since, 
the control is understood to be a mechanism for initiating an 
action, the period in which it is an object of selection must 
be indicated to a user. This will indicate to the user that the 
state of the control has changed. The present invention 
provides a control mechanism wherein a single object can 
change its appearance and represent different functions that 
can be implemented by a user. To do this, a mechanism is 
provided to associate the various representations of the 
object with the data that will implement the different func- 
tions. This mechanism may take various forms, such as a 
look up table, pointers, or the like. 

11 Claims, 9 Drawing Sheets 
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Associate Data 



After typing some text and then pressing the "Associate text" button the 10 pushbuttons then take on a 
new visual appearance. The pushbuttons could flash, or change color or whatever seems appropriate to 
indicate the user should click a pushbutton to associate the text from the entry field with the pushbutton 
control. Note: in the figure the 10 pushbuttons are given a thicker border to indicate this state. 

Once a button is pressed or a timeout has elapsed, the buttons would return to their previous state and 

work like a pushbutton should. 
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STEP 2 



STEP 3 



STEP 4 



STEP 6 



CREATE A SERIES OF CONTROLS THAT CAN 
HAVE END-USER CUSTOMIZATION TO THEM 
(e.g. A SERIES OF PUSHBUTTONS) 



PROVIDE A MECHANISM TO RETRIEVE THE 
END-USER CUSTOMIZATION DATA BOUND 
FOR ONE OF THE CONTROLS 



GO INTO A STATE WHEREBY THE CONTROL 
CAN BE SELECTED BY A CLICK TYPE ACTION 
FROM THE USER 



STEP 5 




ASSOCIATE THE CUSTOMIZATION DATA WITH 
THE CONTROL THAT WAS CLICKED 



STEP 7 

LEAVE THE STATE THE CONTROL IS IN AND 
RETURN TO THE CONTROLS DEFAULT STATE 



STEP 8 



( END ) 



FIG. 9 
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MULTIFUNCTION CONTROL WITH 
CHANGEABLE APPEARANCE 

CROSS REFERENCE TO RELATED 

APPLICATIONS 5 

The present application is related to the following appli- 
cations: Ser. No. 08/753,081, entitled "Creating Real- World 
Objects" (Attorney Docket AT9-96-204); Ser. No. 08/753, 
082, entitled "Data Processing System and Method for 
Controlling a View of a Realistic Object in a Display 10 
Device" (Attorney Docket AT9-96-212); Ser. No. 08/753, 
077, entitled "Prioritization of Background Display During 
Animation" (Attorney Docket AT9-96-213); Ser. No. 
08/753,076, entitled "System and Method for Maintaining 
Size and Position Relationships for Non-Rectangular Real 15 
World Objects" (Attorney Docket AT9-96-237); Ser. No. 
08/753,124, entitled "Data Processing System and Method 
for Scaling a Realistic Object on a User Interface" (Attorney 
Docket AT9-96-240); Ser. No. 08/753,078, entitled "Data 
Processing System and Method for Viewing Objects on a 20 
User Interface" (Attorney Docket AT9-96-241); Ser. No. 
08/753,079, entitled "Data Processing System and Method 
for Performing Automatic Actions in a Graphical User 
Interface" (Attorney Docket AT9-96-242); and Ser. No. 
08/753,123, entitled "A Data Processing System and 25 
Method for Modifying a Size of a Realistic Object on a User 
Interface" (Attorney Docket AT9-96-246). All of the above 
applications are being filed on the same date as the present 
application and assigned to the assignee of the present 
application. 30 

BACKGROUND OF THE INVENTION 

The present invention relates to a data processing system 
for presenting a representation of real-world, non-standard, 35 
complex objects in a graphical user interface (GUI). More 
particularly, a process is utilized that allows an object to 
have more than one set of data associated with it, which may 
be used to perform distinct functions. 

Object oriented programming is a known technology ^ 
which encapsulates data and methods into a programming 
entity called an object. By protecting certain methods and 
data through a public interface, an object oriented program 
can insulate each component from changes to other compo- 
nents yet provide the needed functions with a minimum of 45 
reprogramming. For more background information on object 
oriented technologies, concepts and conventions, please see 
the following references, Object Oriented Design with 
Applications, Grady Booch (The Benjamin/Cummins Pub- 
lishing Company, 1990) and Object Oriented Software 50 
Construction, by B. Meyer, (Prentice Hall, 1988). 

Typically, graphical user interfaces present everything in 
terms of windows, which include items such as a size border, 
rectangular client, menu, title bar and the like. These items 
are not found in real -world objects, such as a telephone or 55 
a book that sits on a user's desk. Current data processing 
technology is moving towards displaying these real-world 
objects on the computer screen. It is very desirable to have 
the real -world object on the GUI desktop appear very similar 
to what a user experiences in real life. 50 

There is commonly a need in graphical user interfaces 
(GUIs) for a user to assign data to customize an operation. 
For example, the action of pressing a button, or selecting an 
object represented by an icon will cause a certain functional 
activity to be performed. Customization of this functional 65 
activity occurs when a particular data structure is associated 
with the object. That is, an object may perform the function 
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of sending a document to a printer. The data structure that is 
used to send the can be changed such that the document icon 
may send a document to another interconnected computer. 
However, in either case, there is one object and different data 
is associated with this object. To perform this association, a 
dialog is initiated that will cause the data to be received and 
ultimately assigned to a particular object to perform a 
specific action. 

For a single object to perform a single activity, the 
previous dialog is sufficient. There is basically a one to many 
relationships that is developed. That is, one object can be 
associated with many actions. However, it would be desir- 
able to have a case where a single object is capable of 
performing multiple activities. In this manner a user will 
have the option of choosing multiple selection points (e.g. 
softbuttons or the like) to perform multiple activities. Thus, 
a need exists for a system that allows many selection points 
to be associated with many data structures. 

Therefore, it can be seen that a need exists for a system 
and method which provides a mechanism that indicates 
which data structures is to be associated with a particular 
selection point. 

SUMMARY OF THE INVENTION 

In contrast to the prior art, the present invention provides 
a mechanism for controlling the selection, in a single object, 
of multiple activities implemented by plural data structures. 

Broadly, the present invention provides a control mecha- 
nism for associating many selection points with many 
actions. That is, instead of associating data with an action, 
the present invention associates the action with the data. 
Therefore, the object of selection becomes the control 
element, rather than merely the initiator of the action. Since, 
the control is understood to be a mechanism for initiating an 
action, the period in which it is an object of selection must 
be indicated to a user. This will indicate to the user that the 
state of the control has changed. 

Thus, the present invention provides a control mechanism 
wherein a single object can change its appearance and 
represent different functions that can be implemented by a 
user. To do this, a mechanism is provided to associate the 
various representations of the object with the data that will 
implement the different functions. This mechanism may take 
various forms, such as a look up table, pointers, or the like. 

Therefore, in accordance with the previous summary, 
objects, features and advantages of the present invention 
will become apparent to one skilled in the art from the 
subsequent description and the appended claims taken in 
conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a data processing system 
including a central processing unit (CPU) which is capable 
of implementing the present invention; 

FIG. 2 shows a typical GUI with a workplace window 
having the various objects that are included on the user's 
workplace; 

FIG. 3 is a more detailed representation of the GUI of 
FIG. 2 wherein the user has opened one of the objects on the 
workplace such that a window associated with that particular 
object is now displayed; 

FIG. 4 is another detailed representation of the GUI of 
FIG. 2 showing the workplace window, the window corre- 
sponding to the open object of FIG. 3 and the real-world 
object of the present invention; 



05/24/2004, EAST Version: 1.4.1 



5,815,153 

3 4 

FIGS. 5A, 5B and 5C are various representations of the computers are so good at, such as remembering names and 

real-world object of the present invention in different func- numbers, finding and entering (dialing) Lhe number quickly, 

tional states; and The present invention allows a user to answer and place calls 

FIG. 6 is an architectural diagram of the various compo- without picking up a physical handset, 

nents which implement the present invention; 5 Some of the differences between the present invention and 

FIG. 7 is a mechanism for associating data with an object other telephone applications are that the telephone object of 

in accordance with the present invention; toe present invention always displays the image of a real 

~„ 0 . tI _ r tU u • f uir n telephone regardless of how the user is currently interacting 

FIG. 8 is another view of the mechanism of FIG. 7 . * . _ ° . t c . . * , ° 

, . . u . . . m n A-fF-~ n * o with it. Further, the object of the present invention does not 

wherein the objects have a different appearance; ana in , . , • . J j 

J rr 10 need a window border around it; it sits right on your desktop. 

FIG. 9 is a flowchart of the process implemented by the ft ^ recognizablc at any size> and m bc made „ big or ^ 

present invention to associate different data with the same smaU ^ desired without ^rfcTing ^th its functions. Even 

0D J ecl - when the object is displayed as an icon, it can be used to 

DETAILED DESCRIPTION OF THE answer calls or dial the user's speed-dial numbers, or to dial 

PREFERRED EMBODIMENTS 15 a aumber ™ng the keyboard. 

A user can dial numbers manually either by clicking on 

The telephone object of the present mvention is a user me phone ob j ect > s keypad ^ib the mousef or by ^fog the 

interface design for a new, real-world user interface style. It computer's number keys. (You can even type in the letters 

is built using C++ and implements a reusable framework. A fof telephone Dum bers such as 1-800-CALLIBM.) When a 

shortcut function allows the properties page of the tele- 20 pers0Q being caUed answers> start talking. The present 

phone's shortcut icon to assign a shortcut key. This will mvenlion telephone object uses the microphone and speaker 

allow a user to access the phone at any time. For example, prov i d ed with the user's computer system such that hands- 

the shortcut key will bring the telephone to the top when it &ee conver sation is possible. When the user has completed 

is covered by other windows. Also, the phone will automati- me tele p hone conversation click on the handset portion of 

cally answer if it's ringing when the user presses the shortcut 25 me ob j ect to ban g up 

^ ey * To receive an incoming call, the user answers by again 

Additionally, one embodiment of the telephone object of selecting the handset portion of the object and begin talking, 

the present invention will allow the object to be My The t mvemion also indudes a speed . dial ^ 

displayed ^ during moving and sizing. This dynamic display ^ d ^ can be M durin the dme riod when a 

of the object during sizing can be implemented by using a onc ^^xion is occurring or after the call is 

software program such as Plus from Microsoft Corp). It is finished ^ d ^ ial be ^ t0 allow access t0 

also possible to display the traditional outline box during numbers whicfa m ^ Q ^ QT {Q emergency numbers> 

resizmg. j Q ^ tne SDeed _ d i a i function, click on the handle portion of 

During dialing, the user can insert a pause by entering a ^ me drawer , which is located at the bottom edge of the 

comma (,) for a 2 second pause or semicolon (;) to wait for telephone object. The drawer will slide open, displaying an 

another dial tone. area where the spe ed-dial buttons can be set. That is, type the 

Telephone numbers are often made up of names or name of the person, or entity, to which speed-dial access is 

acronyms that are easy to remember, but difficult to dial on desired, then fill in the desired telephone number in the 

a real phone (for example, 1-800-CALLIBM)- witn tne 40 Number field and press the Add Name button. The name and 

telephone object of the present invention a user can just type number will appear in the list above the entry fields. Next, 

the letters on the keyboard. The present invention translates pre ss the Set Speed Dial key. In response, the speed-dial 

the letters to the desired phone number, and automatically buttons will flash. Select the button you want to assign to this 

dials the number. speed -dial number. The name and number entered by the 

The telephone object of the present invention is also 45 user will appear beside its associated speed-dial button, 

capable of combining speed dial numbers with numbers When the speed-dial number is set, the user selects the 

keyed in by the user. For example, if 9 must be dialed to get handle of the drawer to return it to its original position, 

an outside line, a user can just enter the numeral 9 and then The telephone object of the present invention can be 

select the speed dial button. displayed as it first appeared, with both the number pad and 

The present invention is implemented such that a user can 50 the speed-dial buttons, or in a simpler state, the base function 
close the "object", if required by the specific operating view. To change between these presentations, a toggle 
system. However, the present invention supports operating switch located on the telephone object just above the speed- 
systems wherein closing the object by the user is not a dial buttons is selected. In order to stretch or shrink the 
necessity. In a preferred embodiment the telephone object of telephone object, the user can move the mouse pointer over 
the present invention supports closing the object as required 55 any edge of the phone object. The pointer will change to a 
by the majority of current operating systems, such as Win- diagonally oriented sizing pointer. While this new pointer is 
dows 95 (available from Microsoft Corp). This closing, and showing, press down the left mouse button and drag the edge 
other functions, is implemented through a pop-up menu. Just of the telephone object to change its size. No matter how 
select the telephone object (e.g. by clicking a first mouse large or small you make it, the telephone object can still be 
button over the object to see the pop-up menu, and then 50 used. 

clicking a second button over the option to be selected by the in a preferred embodiment, the present invention is imp le- 
aser, mented in the C++ programming language using object 
The telephone object of the present invention has been oriented programming techniques. C++ is a compiled lan- 
designed to work in much the same way as a physical guage. The programs are written in human readable script 
telephone located on a desk, wall, car or pocket. But, unlike 65 and this script is provided to another program called a 
a physical telephone, it works through the computer. The compiler to generate a machine readable numeric code 
present invention takes advantage of the functions that which can be loaded into, and directly executed by the 
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computer. The C++ language possesses certain characteris- to define classes and the objects which are later created from 
tics which allow a software developer to easily use programs them as related through a class hierarchy. Specifically, 
written by others while still provided a great deal of control classes may be designated as subclasses of other base 
over the reuse of programs to prevent their destruction or classes. A subclass "inherits" and has access to all of the 
improper use. The C++ language is well known and many 5 public functions of its base classes as though these functions 
articles and text are available which describe the language in appeared in the subclass. Alternatively, a subclass can over- 
detail, ride some or all of its inherited functions or may modify 
As known by those skilled in the art, object oriented some or all of its inherited functions by defining a new 
programming techniques involve the definition, creation, function with the same form. 

use and instruction of "objects". These objects are software 10 The creation of a new subclass borrowing the function- 
entities comprising data elements and routines, or methods, ality of another class allows software developers to easily 
which manipulate the data elements. The data and related customize existing code to meet their particular needs, 
methods are treated by the software as an entity as an be Although object oriented programming offers significant 
created, used and deleted as such. The data and functions improvements over other programming concepts, program 
enable objects to model their real world equivalent entity in 15 development still requires significant outlays of time and 
terms of its attributes, which can be presented by the data effort, especially if no pre-existing software programs are 
elements, and its behavior which can be represented by its available for modification. Consequently, a set of 
methods. predefined, interconnected classes are sometimes provided 

Objects are defined by creating "classes" which are not to create a set of objects and additional miscellaneous 
objects themselves, but which act as templates which 20 routines which are all directed to performing commonly 
instruct a compiler how to construct the actual object. For encountered tasks in a particular environment. Such pre- 
example, a class may specify the number and type of data defined classes and libraries are typically called "frame- 
variables and the steps involved in the functions which works" and essentially provide a prefabricated structure as a 
manipulate the data. An object is actually created in the basis for creating a working application program, 
program by means of a special function called a constructor 25 For example, a framework for a user interface might 
which uses the corresponding class definition and additional provide a set of predefined graphic interface objects which 
information, such as arguments provided during object create windows, scrollbars, menus and the like, and provide 
creation, to construct the object. Objects are destroyed by a the support and "default" behavior for these graphical inter- 
special function called a destructor. ^ face objects. Since many frameworks are based on the object 

Many benefits arise out of three basic properties of object oriented techniques, the predefined classes can be used as 

oriented programming techniques, encapsulation, polymor- base classes and the built in default behavior can be inherited 

phism and inheritance. Objects can be designed to hide, or by developer defined subclasses and either modified or 

encapsulate, all or a portion of, the internal data structure overridden to allow developers to extend the framework and 

and the internal functions. More particularly, during pro- 35 create customized solutions in a particular area of expertise, 

gram design, a program developer can define objects in This object oriented approach provides a major advantage 

which all or some of the data variables and all or some of the over traditional programming since the programmer is not 

related methods are considered "private" or for use only by changing the original program, but rather extending the 

the object itself. Other data or methods can be declared capabilities of the original program. In addition, the frame- 

"public" or available for use by other software programs. ^ work provides architectural guidance and modeling and, at 

Access to the private variables and methods by other pro- the same time, frees the developers to supply specific actions 

grams can be controlled by defining public methods which unique to the problem domain. 

access the object's private data. The public methods form an Therefore, those skilled in the art will understand how the 

interface between the private data and external programs. An present invention is implemented using object oriented 

attempt to write program code which directly accesses the 45 programming techniques as described above, 

private variables causes a compiler to generate an error Referring to FIG. 1, a typical data processing system is 

during program compilation. This error stops the compila- shown which may be used in conjunction with the present 

tion process and prevents the program from being run. invention. A central processing unit (CPU), such as one of 

Polymorphism allows objects and functions which have the PowerPC microprocessors available from IBM Corpo- 

the same overall format, but which work with different data, 50 ration (PowerPC is a trademark of IBM) is provided and 

to function differently to produce consistent results. For interconnected to various other components by system bus 

example, an addition method may be defined as variable A+ 12. An operating system 41 runs on CPU 10 and provides 

variable B, (A+B). The same format can be used whether the control and is used to coordinate the function of the various 

A and B are numbers, characters or dollars and cents. components shown in FIG. 1. Operating system 41 may be 

However, the actual program code which performs the 55 one of the commercially available operating systems such as 

addition may differ widely depending on the type of vari- DOS, or the OS/2 operating system available from IBM 

ables which comprise A and B. Thus, three separate method Corporation (OS/2 is a trademark of the IBM Corporation), 

definitions can be written, one for each type of variable A program application 40 runs in conjunction with operating 

(numbers, characters and dollars). After the methods have system 41 and provides output calls to the operating system 

been defined, a program can later refer to the addition 50 41 which implements the various functions to be performed 

method by its common format (A+B) and, during by the application 40. 

compilation, the C++ compiler will determine which of the a read only memory (ROM) 16 is connected to CPU 10, 

three methods to be used by examining the variable types. v ia bus 12 and includes the basic input/output system 

The compiler will then substitute the proper function code. (BIOS) that controls the basic computer functions. Random 

A third property of object oriented programming is inher- 65 access memory (RAM) 14, I/O adapter 18 and communi- 

itance which allows program developers to reuse pre- cations adapter 34 are also interconnected to system bus 12. 

existing programs. Inheritance allows a software developer It should be noted that there is software components includ- 
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ing the operating system 41 and application 40 are loaded 
into RAM 14 which is the computer system's main memory. 
I/O adapter 18 may be a small computer system interface 
(SCSI) adapter that communicates with the disk storage 
device 20, i.e. a hard drive. Communications adapter 34 5 
interconnects bus 12 with an outside network enabling the 
data processing system to communicate with other such 
systems over a local area network (LAN), wide area network 
(WAN), or the like. Input/output devices are also connected 
to system bus 12 via user interface adapter 22 and display 
adapter 36. Keyboard 24, trackball 32, mouse 26 and 
speaker 28 are all interconnected to bus 12 through user 
interface adapter 22. Display adapter 36 includes a frame 
buffer 39 which is a storage device that holds a representa- 
tion of each pixel on the display screen 38. Images may be 
stored in frame buffer 39 for display on monitor 38 through 
various components such as a digital to analog converter, 
(not shown) and the like. By using the aforementioned I/O 
devices, a user is capable of inputting information to the 
system through the keyboard 24, trackball 32 or mouse 26 
and receiving output information from the system via 
speaker 28 and display 38. 

Referring to FIG. 2, the window is designated generally 
by the numeral 111. Window 111 includes a border with 
frame 113 that forms the outer boundary of the window. ^ 
Contained within border 113 are a title bar 115 and an action 
bar 117. The remainder of window 111 consists of a client 
area 119, which is populated with a plurality of icons, 
including a folder icon 121, which is labeled "project X", 
and a printer icon 123. 30 

Title bar 115 includes a window title 125 which identifies 
the window, a system menu icon 127 and window sizing 
icon 129. System menu icon 127 allows the user to display 
a pull-down menu containing actions that the user can 
perform on the window. Such actions are related to the 35 
window itself and not to the object that is displayed in the 
window. For example, actions include MOVE, which allows 
the user to reposition the window on the screen, MINIMIZE, 
which reduces the window's size, and MAXIMIZE, which 
enlarges the window to the size of the screen. Window sizing ^ 
icon 129 provides a fast way to use a mouse or pointing 
device 133 to perform the actions of MINIMIZE and MAXI- 
MIZE without requiring a menu. 

Action bar 117 contains a list of the actions of the 
application shown in the window. Each action in the list in 45 
the action bar has an associated pull-down menu to list the 
individual actions that are contained within each general 
action listed in the action bar 117. For example, the FILE 
pull-down enables the user to work with files through 
actions that manipulate the file as a whole. The individual so 
actions contained within the FILE action include NEW, 
which allows users to create a new file, and SAVE, which 
writes the existing file to a storage device. 

Turning now to FIG. 3, there is shown in addition to 
window 111, an object window 131. Object window 131 55 
contains the contents of the "project X" folder represented 
by icon 121. Window 131 was opened by operating the 
pointer 133 to open icon 121. 

Window 131 is similar to window 111 in that it includes 
a frame 135, a title bar 137, an action bar 139, and a client 60 
area 141 that is populated with a plurality of document and 
chart icons, including a "chart 1" icon 143. Title bar 137 of 
window 131 includes a title bar mini- icon 145 which is a 
copy of "project X" icon 121. Window title bar mini-icon 
145 is placed in the title bar, rather than in the client area 141 65 
of window 131, but is also capable of being directly manipu- 
lated by the user. 



Referring to FIG. 4, workplace window 111 is once again 
shown having object window 131 opened such that a user 
can interact with the document associated with Project X. An 
additional window 200 has also been opened which is in the 
form of a "real world" window. In this example, real world 
object 200 is a representation of a telephone. It can be seen 
that telephone object 200 is surrounded by an irregularly 
shaped frame 210 which encompasses the object. Those 
skilled in the art will understand that FIG. 4 merely shows 
a telephone object as an example. Thus, the present inven- 
tion is not limited to telephone objects, but contemplates all 
real world type objects which can be created using the 
system and methods of the present invention. 

Telephone object 200 is seen to include a handset 202, 
speed dial functions 206 and a toggle switch 208. Further, it 
can be seen that the telephone object window 200 is irregu- 
larly shaped and includes curved and rounded edges which 
are known to be extremely difficult to render on the display 
of a data processing system. For example, it can been seen 
that the area 204 is not part of the telephone object 200, but 
is substantially enclosed by the distance between the handset 
and the body of the telephone object 200. 

Further, it should be noted that telephone object 200 is not 
merely a bitmap representation of a telephone, but is a 
functional window in the same manner as workplace win- 
dow 111 and object window 131. For example, the telephone 
may be answered upon receipt of an incoming call by 
clicking on handset 202. Additionally, a telephone number 
can be dialed by selecting one of the names associated with 
speed dial functions 206. An entry portion 212 allows a user 
to enter the number or numbers to be dialed when placing an 
outgoing call which has not been set up for speed dialing. A 
volume control 214 is provided as a slide switch that allows 
a user to control the sound volume which another party 
participating in a telephone call using object 200 can be 
heard. The preceding functions are given as examples of the 
types of controls available to be used when object 200 is a 
real world working telephone. Of course, other functions 
would be present when the object emulates other real world 
items, such as a fax machine, compact disk players, or the 
like. 

Therefore, it can be seen when considering the functional 
elements of object 200 that this telephone represents an 
operational window in the same manner as window 111 and 
131. However, the real world object 200 does not include 
such control items as action bar 117, title bar 137, action bar 
139, window sizing icons 129 or the like. That is, the 
functionality provided in a conventional window by such 
items as title bars, action bars and pull-down menus, is 
provided by the real world functional controls of, in this 
case, a telephone. For example, to place a call the user clicks 
on handset 202 when using the present invention. In normal 
real world calling, the user would physically pick up the 
handset to begin speaking. Thus, there is a direct correlation 
between the action that a user of the present invention 
implements and the real world action that a person placing 
a telephone call on a physical telephone will make. Of 
course, the actions provided by telephone object 200 could 
be implemented in a non-real world object through the use 
of action bars, pull-down menus and selection of various 
operational actions, however, this conventional technique 
would require additional user actions and time before the 
desired result is obtained (placing a telephone call). 

Next turning to FIG. 5, three separate telephone objects 
200 are shown at various operational stages. In FIG. 5A, 
phone object 200 is shown essentially as was previously 
described with regard to FIG. 4. Therefore, FIG. 5A will not 
be described again at this time. 
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FIG. 5B is an enlarged version of telephone object 200 
and shown by reference numeral 201. In addition to the 
various components shown by telephone object 200 of FIG. 
5 A, object 201 includes a number pad 218 which allows a 
user to enter telephone numbers to be called. 5 

Additionally, entry pad 218 includes a redial, flash and 
mute buttons for performing other functions associated with 
a real world telephone. Again, toggle switch 208 is shown 
which is used to display a different representation of the 
telephone object 201, such as changing between a two- 10 
dimensional and three-dimensional object. Handset 202a is 
shown in the active state since it is turned to face a user and 
is not shown as resting on cradle 203. A pullout drawer 
handle 216 is shown which allows additional functions to be 
presented to a user of telephone object 201. By selecting the 15 
arrow associated with pullout drawer 216, drawer 228 is 
opened. In this case, the functions included in drawer 228 
relate to setting speed dial numbers and buttons 206. Name 
field 220 allows a user to enter the name of the person to be 
added to one of the speed dial buttons 206. Number field 222 20 
allows a user to enter the telephone number to be associated 
with the name of the person previously entered in field 220. 
The name and number is then included in a list box 226 
which associates the name and telephone number with one 
another. Functional keys 224 then allow the user to associate 25 
the entered name and number with one of the speed dial 
buttons 206. Additionally functional buttons 224 allow a 
user to select various operations such as dialing the person 
just added to the speed dial function, delete a person's name 
and number from the speed dial function, or the like. Upon 30 
completion of the speed dial activity, a user selects drawer 
tab 216 and the drawer is then closed such that the telephone 
object 201 of FIG. 5C returns to the appearance shown in 
FIG. Sb f as previously described. 

Referring to FIG. 6, an architectural block diagram is 35 
shown with application 40 running on top of an operating 
system 41. Application 40 may include one of the word 
processing applications, such as WordPerfect, Word, 
WordPro, or the like. Application 40 interacts with an 
operating system 41 through an application programming 40 
interface (API). Operating system 41 may include one of the 
Window's operating system from Microsoft Corporation, as 
well as OS/2 from the IBM Corporation. Application 40 
calls various functional routines included within operating 
system 41. These routines are shown as modules 50 included 45 
in the operating system. In the case of the Window's 
operating system, modules 50 can be characterized as 
dynamic link libraries (DLLs) which interpret a call from the 
application 40 and then, in response thereto, perform the 
desired function. For example, application 40 may issue a 50 
draw triangle command. Operating system 41 then routes 
this command to the appropriate module 50 that performs 
the draw triangle function. The appropriate module 50 then 
outputs hardware instructions to data processing system 1 to 
implement the draw triangle command. Operating system 41 55 
and data processing system 1 interact through a hardware 
interface. A compiler outputs the hardware instructions to 
the data processing system 1, particularly central processing 
unit 10 where the instructions are decoded and executed on 
various processing, or execution units in the CPU (not 60 
shown). 

As noted in FIG. 1, data processing system 1 includes a 
frame buffer 39 located in display adapter 36. Frame buffer 
39 is a storage device which holds information relating to 
each picture element (pixel) of a display screen 38. The 65 
information in frame buffer 9 corresponding to each indi- 
vidual pixel will cause that pixel to be painted, with a 



particular color or shade. The information stored in frame 
buffer 39 is then provided to a monitor 38 for display to a 
user of the data processing system. 

In particular, frame buffer 39 may store information 
relating to a window 51 to be rendered on display 38. 
Conventional window 51 would include elements such as a 
title bar 52, border 53, sizing element 56 such as an arrow, 
and the like. Next, the triangle 54 is shown displayed inside 
of window 51 by illuminating pixels 55 to form the shape of 
a triangle as requested by application 40. The present 
invention provides a window in the form of a real world 
object which does not include borders 53, title bar 52 and 
frame 57 of window 51. 

In typical graphical user interfaces (GUIs), everything is 
presented in window form. In these GUIs, a window can 
consist of rectangular items including a size border, rectan- 
gular client, menu and title bar. The rectangular client is 
typically a window such as the object window 131 previ- 
ously described with regard to FIG. 3. The preceding items 
are not found in real world objects such as telephone, book, 
fax machine, or the like that sits upon a user's desk. Ideally, 
real world objects appearing on a GUI desktop should be as 
similar to what is found in real life as possible. 

Returning to FIG. 5C which is a representation of a real 
world object, such as a telephone as previously described. 
The present invention will now be described using the real 
world object of FIG. 5C as an example. However, it should 
be understood that many other software objects can be used 
and are contemplated by the present invention. In the 
telephone object of FIG. 5C, a mechanism is used which will 
associate a person's name and a phone number with a speed 
dial button 206. As previously noted, the user enters the 
person's name and number into fields 220 and 222, respec- 
tively when setting the speed dial function. More 
particularly, the user enters the person's name into field 220 
and number into field 222 to add this data to the list of names 
and numbers currently known to the program. The name and 
number will then be shown in field 226 which is a list box, 
or the like. A user then selects the item, i.e. the name and 
associated number, which is to be associated with a speed 
dial button 206. The user then selects a set speed dial button, 
which may be one of the buttons 224 as shown in FIG. 5C. 
At this time, all of the speed dial buttons 206 begin flashing. 
It should be noted that in FIG. 5C the object shows nine 
speed dial buttons 206 and a button associated with user 
comments. However, it should be understood that any con- 
figuration and number of buttons could be utilized and the 
object will remain within the scope of the present invention. 

Subsequent to the selection of the set speed dial button, all 
of the speed dial buttons 206 begin flashing (change their 
state). This is accomplished through an inverting of the 
normal painted button 206. More particularly, the pixels 
representing the buttons 206 in frame buffer 39 are alter- 
nately illuminated and then ignored in order to give the 
flashing appearance. A time period is then begun wherein if 
the user presses one of the flashing speed dial buttons 206 it 
is updated to indicate the associated name and number. That 
is, a flashing speed dial button is associated with specific 
data (in this case, the name and number of the person to be 
called using the speed dial function). This name and number 
will be associated with whichever flashing speed dial button 
206 that the user has selected. Thus, it can be seen that a 
button, or selection point, 206 which appears to be flashing 
is associated with a particular set of data which is used to 
indicate the name and telephone number of a person to be 
called by the user with the speed dial function of the object 
shown in FIG. 5C. It can be seen that a telephone object with 
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flashing buttons will give the object an appearance different cator to prompt a user to select a particular button. In FIG. 

from the telephone having buttons that are not in a flashing 8, pushbuttons 302a are the same objects as pushbuttons 302 

state of FIG. 7, however buttons 302a have been given a thicker 

However, if after the time period has elapsed (e.g. 10 b «* r 10 a diS ™ Di ,- In ** previous discussion 

seconds), the selection points 206 will cease flashing and 5 native to telephone object 210, the speed dtalbu tons were 

. \i_ * i <l c j j- i u » given a flashing appearance when they changed state. Once 

return to their normal tuncupn of a speed dial button. Hius, ^ ^ ^J/^^ pushbm ^ n 302J or a predeter- 

it can be seen that buttons 206 will be associated with greater ^ rio / has ela ^ pushbuttons 302a return to 

than 1 sets of data to perforin multiple functions. More ^ ious ^ ^ shown b buUons 302 m mG ? and 

particularly, when buttons 206 are functioning as speed dial form ^ function lhat was Kt by the ^ 

buttons, they will be associated with data required to com- 10 T ... c 1 ** . . „ • 
\ , . . r In this manner the action of selecting a pushbutton is 
plete a telephone call. This data includes arbitrating for . t , . t . t . , , „ , t - a - n>l ~, 
r .-r . i_ ■ j * *i 1 associated with particular data, i.e. data m field 304. Thus, 
ownership of a system bus in order to control a modem, or r t . . t ' . ... r , , 
. 1 . • • the present invention associates action with one of a plural- 
other network device, attached to the data processing sys- . t r e j . . j ■ . *u 1-1 

VT A i -ii 1 • . • » J \ lty of data structures, commands, instructions, or the like, 

tem. Next, protocols will need to be issued in order to ... . . . ■ . . , ^ . « 

communicate with the modem and cause it to dial the user's " ' l ■? ust 6,5 ™V***™ A ^at lhe f dala ^ of fi e W 

specified telephone number. Therefore, the telephone object 304 w ™- 8 » merelv "P^tne of text that could be 

of HO. 5C and particularly, the speed dial buttons 206 are f*ociated with a particular pushbutton 302a and is not a 

an exemplary mechanism where a portion of an object hmi « ll °° °* the ^ of faaB ^ can te •««•»> 

indicates different functions and different associated data W1,h the f . butt ° n f- More parUcu arly, a user may type a 

structures even though the object (speed dial button 206) » command mlo field 304 such as begin word processing 

• * and then select the associate data button 306. At this time, 

remains the same. , , _„ .„ , . . - 

. , . , , . , pushbuttons 302 will alter their appearance to a form as 

Referring to FIG. 7, a mechanism is shown which asso- showQ b buUons 3ft2fl> Qr the ^ whefein me user 

ciates information, including data and commands with a ^ 0Qe of ^ ^ ^ ^button L ^ raecha . 

particular object. It should be noted that many such mecha- nism 300 ^ returas tQ ^ ^ M shown m nG ? and 

msms could be used by one doited in the art to make this 25 WQen hbutton t fc a word processiDg applica- 

association and the particular implementation shown in RG. lioa ^ be launched . similarly, a user may enter a name and 

7 is merely an example. The association rnechan ism 300 is lel hone number of a t0 be called in fidd 304 and 

shown m the form of a window, but could be represented as ^ ^ daU buttQD 3Q6 ^ the pushbuttons 

another real world object such as a notepad, or the hke in the t {h h w ^ ^ QWQ [n FIG 8 ^ cfa state and the 

same manner that real world object 210 has been shown and user can once again pushbutton x whereiD the mecha . 

previously desenbed. nism revefts back l£) me ^ showQ in ? 

Mechanism 300 includes a plurality of pushbuttons 302. Therefore, it can be seen that not only does mechanism 

In this example there are 10 such pushbuttons shown as PB1 300 ^ pus hbuttons to be used for various functions, that 

thru PB10. In an initial state, buttons 302 are associated with 35 ^ mechanism 30 0 can be used for speed dial functions, 

a first set of data that performs a first function or operation. launc hing applications and the like, but also allows the 

For example, pushbuttons 302 could be used as speed dial pushb u tt ons to perform their intended function and to asso- 

buttons, as previously described. When being used as speed date dala Qf commands ^ mat particular button. TTiat is, 

dial buttons, the data associated with a particular pushbutton one fonclioil p erformed by a pushbutton may be the acuon 

302, e.g. PB1 could be a user's name and telephone number. ^ of speed dialingj or the ^ while a funclion may ^ 

However, pushbuttons 302 could also be used to perform t0 perform the association of data in field 304. Additionally, 

different functions such as opening files, launching an appli- pushbuttons 302 may be capable of providing a plurality of 

cation or printing a document. An associated data field 304 appearances, i.e. normal as in button 302, wide border for 

is provided in mechanism 300 where a user inputs the type button 302a and flashing for yet another function. For 

of data to be associated, or linked, with a particular push- 45 example, button PB1 302 may represent speed dialing, 

button 302. button PB1 302a may be for associating new data, com- 

As shown in FIG. 8, text may be entered in field 304 and mands and a flashing appearance of PB1 could be for 

subsequently associated with a particular pushbutton. sending a fax, or printing a document. 

Additionally, functional instructions can also be entered to FIG. 9 is a flowchart of the process implemented by the 

field 304 such that the system will then perform a particular 50 present invention to associate particular data with an object, 

command when the associated pushbutton is selected. For At step 1, the process is started and at step 2 a series of 

example, the command "word processing" could be associ- controls to be customized by a user are created (e.g. 

ated with a particular pushbutton 302 such that when that pushbuttons). At step 3, a mechanism is provided to retrieve 

particular button is selected, a batch file is invoked that will the end user customization data bound for one of the 

cause a word processing software application to be started. 55 previously created controls. For example, the user entered 

Thus, it can be seen how the pushbuttons may have various data or commands in field 304 is retrieved. The process then 

multi-functional aspects, such that various operations can be continues to step 4 where the mechanism is in a state 

implemented, i.e. speed dialing, opening of files, printing, whereby the customized controls (pushbuttons) can be 

opening program applications, and the like. selected by a user using a click-type action, such as a mouse 

In order to associate data and/or commands with a par- 60 click, stylus, trackball and pointer, or the like. At step 5, it 

ticular pushbutton, the user enters the specific data or text to is determined whether the user did in fact choose one of the 

be associated with one of the pushbuttons 302 into field 304. controls to associate the customization data. If no, the 

Once the data is entered at field 304, an associate data button process continues to step 7 where the control button is left 

306 is selected. Upon selecting the associate data button, in its previous state and the mechanism returns to its default 

pushbuttons 302 then present a new visual appearance. For 65 condition. However, if at step 5 it is determined that the user 

example, the pushbutton controls 302 could flash, change did choose one of the controls then the process associates, or 

color, create a new border or some other appropriate indi- links, the customization data or commands with the control 
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that was selected by the user. This association can be 
accomplished using pointers, a look-up table, or the like. 
Subsequent to step 6, the process continues to step 7 where 
the mechanism maintains the association between the cus- 
tomization data and the control and the process returns to the 5 
default state. Subsequent to step 7, the process ends at step 
8. 

Although certain preferred embodiments have been 
shown and described it should be understood that many 
changes and modifications may be made therein without 10 
departing from the scope of the appended claims. 

We claim: 

1. A data processing system that displays at least one user 
interactable object, comprising: 

means for causing said object to be displayed having a 
first appearance and a second appearance wherein said 
object comprises at least one control capable of altering 
its appearance between a first state and a second state; 

means for associating a first function with said object 2Q 
having said first appearance and a second function with 
said object having said second appearance, said means 
for associating comprises means for linking first infor- 
mation to said object having said first appearance and 
second information to said object having said second ^ 
appearance and means for prompting a user to enter 
said first and second information; 

wherein a user will implement said first function by 
selecting said object having said first appearance, and 
will implement said second function by selecting said 30 
object having said second appearance. 

2. A system according to claim 1 wherein said object is 
displayed having said first appearance when said at least one 
control is in said first state and displayed having said second 
appearance when said control is in said second state. 35 

3. A system according to claim 2 wherein said user 
implements said first function by selecting said control in 
said first state and implements said second function by 
selecting said control in said second state. 

4. A system according to claim 3 further comprising 40 
means for causing said object to change from said first 
appearance to said second appearance. 

5. A system according to claim 4 wherein said first and 
second information includes data, instructions and com- 
mands. 45 

6. A system according to claim 5 wherein said means for 
linking includes pointers and a look up table. 

7. A system according to claim 6 further comprising 
timing means that causes said object to change from said 
second appearance to said first appearance after a predeter- 
mined period of time has elapsed. 



8. A method of displaying at least one user interactable 
object, comprising the steps of: 

causing said object to be displayed having a first appear- 
ance and a second appearance; 

providing said object with at least one control capable of 
altering its appearance between a first state and a 
second state; associating a first function with said 
object having said first appearance and a second func- 
tion with said object having said second appearance, 
said step of associating comprises the step of linking 
first information to said object having said first appear- 
ance and second information to said object having said 
second appearance and the step of prompting a user to 
enter said first and second information; 

wherein a user will implement said first function by 
selecting said object having said first appearance, and 
will implement said second function by selecting said 
object having said second appearance. 

9. A method according to claim 8 wherein said object is 
displayed having said first appearance when said at least one 
control is in said first state and displayed having said second 
appearance when said control is in said second state. 

10. A computer program, having data structures resident 
on a computer readable media, which causes a data process- 
ing system to display at least one user interactable object, 
comprising: 

means for causing said object to be displayed having a 
first appearance and a second appearance, said object 
comprises at least one control capable of altering its 
appearance between a first state and a second state; 

means for associating a first function with said object 
having said first appearance and a second function with 
said object having said second appearance, said means 
for associating comprises means for linking first infor- 
mation to said object having said first appearance and 
second information to said object having said second 
appearance and means for prompting a user to enter 
said first and second information; 

wherein a user will implement said first function by 
selecting said object having said first appearance, and 
will implement said second function by selecting said 
object having said second appearance. 

11. A program according to claim 10 wherein said object 
is displayed having said first appearance when said at least 
one control is in said first state and displayed having said 
second appearance when said control is in said second state. 
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